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Educational Benefit-Cost Analysis 
and the Problem of Scale* 

by Gordon A. Wei ty 
University of Pittsburgh 

Benefit-cost analysis consists in establishing ratios of benefits to 
costs for a set of project variants. Trie decision rule is to select that 
project variant where the ratio is a maximum. The Coleman report on Equality 
of Educationa l Opportunity surprised many when it in essence reported the 
ratios for public educational projects to be of negligible magnitude. We 

argue that specification errors, as well as often noted estimation errors, 

/ 

can contribute to findings for large-scale systems of benefit-:ost ratios 
approximating zero. I 

First we discuss three approaches to benefit-cost analysis, the descrip- 
tive, the -structural , and the experimental approaches, and comment on the 
( 1 )** 

feaslbility of each. A benefit-cost model is then developed for the 

small-scale educational project. When this model is generalized to a large- 
scale system, such as that of public education in an urban school district, 
we we invoke Kulikowski's Second Theorem to prove that scaleup factors such 
as communication and control in the organization, if overlooked in the bene- 
fit-cost analysis, provide specification errors which can contribute to the 
finding of negligible benefit-cost ratios. 
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The three approaches to establishing the relationship between benefits 
and costs that we will now discuss are d escriptive cost-benefit, structural 
cost-benefit, and experimental cost-benefit analysis. 

For a descriptive cost-benefit analysis, one has available a body of 
historical data, say on capital costs and estimated benefits. The costs are 
correlated with the benefits, usuall> by a multi -variate regression technique. 
It is important to notice that there is no concern for an educational pro- 
duction function in this approach. We will return to the notion of the pro- 
duction function in a moment. Suffice it to say here that rather than iso- 
lating factors of production in the economic sense, one merely estimates 

( 2 ) 

(possibly confounded) variables. The accountant would say that the 
budgeting is line-item rather than functional in this approach. 

A good example of a descriptive cost-benefit analysis is the well-known 
E quality of Educational Opportunity study. The combination of step-wise 
regression and non-random selection of units of analysis resulted in rather 
equivocal findings in that study, if one asks the relationship between vari- 
ations of within school costs and variations of benefits or academic achieve- 
ment. 

The structural cost-benefit analysis proceeds logically (deductively) 
to specify a production function. On the rounds, for instance, of expert 
opinion, a project design is developed. This is the basis of the identifi- 
cation of a production function from which cost factors can be derived. The 
production function relates a measure of output from which benefits are esti- 
mated, to a set of factors of production. The factors of production in an 
urban educational project would typically Include employee man-hours, the 
physical plant, and a curriculum and set of media. The factor costs (or 
descriptive data of the first approach) can be derived from the production 
function but not vice versa. , 
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Finally, the experimental cost-benefit approach requires not only the 



identification of factors of production and functional budgeting, as in the 

structural approach, but also the systematic variation of these factors, 

once identified, to ascertain their contribution to the benefits of the 

( 3 ) 

project or system through time. This is the fullest manifestation of 

( 4 ) 

what D rofessor Hartley aptly calls the "Output Emphasis." Only with an 
appropriate noise reducing design and manipulation of factors can the vari- 
ation of output due to each factor, be unequivocally attributed. While it 

is not generally feasible to utilize controlled experiments in large-scale 
( 5 ) 

projects, this approach is widespread at the subproject or "product" 

( 6 ) 

level . 

Of the three approaches, the descriptive approach is the cheapest tech- 
nique. Given the typical paucity of research resources, no other coproach 
is feasible. — -Hence the descriptive approach is suitable, at least by default, 
for large-scale and national surveys. The structural approach, while poten- 
tially as expensive in undertaking as the experimental approach, requires 
minimal political and administrative sanction, hence is suitable, for the 
comprehensive study of small or local projects. The experimental approach, 
requiring as it does elaborate sanction and support, is feasible only on the 
small scale. 

Let us now turn to a characterization of structure in an organization 
such as a large urban school district. In terms of this model of structure, 
we can examine the effects of scale on the outcome of different approaches to 
benefit-cost analysis. 

V 

Let us have a set S of elements {x 0 , x, . . . x„^ together with a set L 
of ordered pairs of distinct elements of S. Each ordered pair (x: , Xs) 6 L 
is called o directed line yy . Suppose further that x- = Xj for the pair of 



lines y.^ and ^ . Let the algebraic structure ^S;l) be connected : there 

is no element of S which is not an element of an ordered pair of L. Finally, 

there exists a unique initiator element x„ e, S such that y (o is not in L. 

_ (7) 

Such a structure^ ;L^ is a t ree , T. 

A walk in a tree is a finite sequence of elements and directed lines 
(• • -X; , y,j » X/ * !/jk » x* . . .) which has an i ni tel element x*. and a 
terminal element x m . The distance d a ^of the walk or the distance from x w 
to x m is the number of directed lines in the sequence initiated with x fc 
and terminated with x m . 

We can model the control or communication channels of an organization 
with such a tree. In particular, the initial element of the longest possible 
walk, or the initiator, is the manager of the organization; a directed line 
is a channel of communication or control; those elements which are never an 
initial element of any walk are subordinates ; and, any elements which are 
initial elements (other than x 0 ) are intermediates . We will suppose that 
every subordinate has a queu e which he services. 

To be very specific, the subordinate will be a teacher in a large urban 
school system and the queue will be his pupils. It is also possible that 
intermediates, and even the manager, will be classroom teachers, hence service 
queues. The comparative value of the servicing of a given queue will be the 
benefit-cost ratio for that queue. We can suppose that benefits are constant 
across queues, hence the objective function is the cost functior. which is to 
be minimized. 

More formally, there is a subset QCS, where xe Q just if x services 
a. queue. There is a function f which maps the domain Q to a codomain fe| . 
Elements of {ej are costs; the mapping is the evaluation of the servicing 
of a queue in terms of cost functions. Moreover, there is another function 



F which maps T into a codomain ^E^ . The elements of are also costs; 

the mapping is the evaluation of the organization in terms of a cost function. 

Let « 

E = Z C'-\) e; 



l~1 



be the aggregation model for an organization of n queues. Ajis an index of 
loss in performance for the i-th queue, a loss associated with communication 
and control among the elements of an organization. A; is presumed to be a 
function g of the distance between the manager, who is the source of a mes- 
sage or command and the recipient. Thus we express the loss associated with 
a message from the o-th element to the j-th element as X; = g(d ). X 

is constrained to the closed unit interval and is isotonic to the magnitude 

(8) 

of loss. 

• In the case of a pilot project, problems of communication and control 
are negligible, if we suppose that the relevant organization is a relatively 
small R & D center or a laboratory school where the organization is relatively 



"shallow." By examination of limit properties, we know that 

tlrw (* — Ay) - £ <?,• t iVm. (l — /L{ ) = ^ | — I »«wt* ) . 

l»i i* > 



-I 






Thus 



imv E = JL e ; 

X ; ->0 









If we additionally make D. Krathwohl's assumption of "typicality of situa- 
(9' 

tions," we can take the objective function of any queue as an n-th of the 
organizational objective function, since from 

and the limiting case of , it follows that E » ne. This is the classi- 

cal model of the organization, the shortcomings of which ny colleague Lundfn 



c 



o 
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( 10 ) 

and I have criticized elsewhere. Under these admittedly idealized condi- 
tions, it has just been shown that the evaluation of a single installation of 
a pilot program is tantamount to the assessment of the entire organization. 

Let us now consider what happens to the assessments e and E in the 
presence of scale effects. When scaleup is undertaken, for instance, in the 
school district wide dissemination and installation of an educational program 
which presumably was successful as a pilot program in a laboratory school, 
problems of communication and control are no longer negligible. 

Now the organization will acquire some "height," as it is plausible to 

( 11 ) 

assume that height and size of an organization are isotonically related. 

It is likewise plausible to assume that height and an index of loss V are 

( 12 ) 

isotonically related. Then the loss function g can be further specified 
by an exponential function such as 




= k 



where k is the loss in performance of a queue for messages and commands for 
unit distance. The organizational objective function is 



e-Z o 

i*» 

where d ; is the length of the walk from the manager (initiator) to the i-th 

t 

queue, and E is again to be minimized. 

Elsewhere my colleague Lundin and I have Discussed the prevalence of 

(13) 

organizations where the value of d varies from queue to queue. As an 

illustration, consider the typical team teaching plan, where a team leader 

is both an Intermediate and a classroom teacher. 

To model this circumstance, we will suppose that Q is partitioned into 

the mutually exclusive and exhaustive subsets Q. and Q. by the criterion 

1 J 



d ; 3^ d- . The objective function becomes 

" ' J 



° t*, ' J’P" 



Collecting terms, we have 



L P i--> r vi*P + l J 

The objective function is a minimum where the bracketed terms on the right- 
hand side of the equation are a minimum. 

Let us now prove the following 

(14) 

Theorem (Kulilowski ‘s "Second Theorem" ): 

If d;> d- , then E is a minimum only if e. < e. . 

4 (J U J 

Proof : For d. > dj , either e t - ej or e- L < ej . If the former, suppose 



e . - e ; . Then 
* . J 



t\~ E * £_k^‘k*(k'‘+kV*i ‘Lk' 4 K' J (k*+k<i)t j 






If <. e.. , then 



P n 



I Vf-ir + 

(in 



Since 






Z Z k ~‘‘ k ‘ 4 (V'‘*i +• kV) < Z k "“ + k‘t) e ; , 

o*p fl 

the theorem is proved. 

So far as the managerial problem in the case of varying values of d can 
be considered an assignment problem, the manager will optimize the organiza- 
tion's performance in terms of the objective function E if he requires those 
queues be relatively most efficient (least costly) which are most distant. 
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Confronting an organization where d varies, can the researcher expect 
the cost function of the organization to have a uni modal or a multimodal 
cost distribution? Clearly it will have a multimodal distribution, which 
reflects the underlying structural differentiation of queues. The local 
cost functions cannot be taken as a surrogate of the organizational cost 
function, and vice versa. In spite of this circumstance, we find in the 
vast majority of research on effectiveness in large-scale systems no attempt 
to block on structural and organizational factors. While this is clearly a 
specification error, in the case of the descriptive approach to benefit-cost 
analysis discussed above, it is an unavoidable error. 
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(1) For a comprehensive discussion of the various modes of economic 
analysis in education, cf. S, Temkin, A Comprehensive Theory of Cost- 
Effecti veness , Philadelphia (1970). 

(2) Cf. J. A. Thomas, "Cost-Benefit Analysis and the Evaluation of 
Educational Systems," Proceedings of the 1968 Invitational Conference 
on Testing Problems , Princeton (1969) , p. 94. 

(3) Cf. Thomas, op. cit. p. 96. 
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Administration Quarterl y V (1969), p. 66. 

(5) Cf. G. H. Fisher, "The Role of Cost-Utility Analysis in Program 
Budgeting," Program Budgeting, ed. 0. Novick, Cambridge, Massachusetts 
(1965), p. 76. 
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1950), pp. 13-20; also, M. KapTan, "The Consumers Union Model." 

•Evaluation: Processes and Practices, Selected Papers from the 

Conference for the Evaluation of Instructional Materials, Washington, 

D. C. (1968), pp. 45-46. 

(7) Cf. F. Harary, R. Z. Norman, and D. Cartwright, Structural Model_s, 

New York (1965), pp. 283ff; also, A. J. Blikle, "Investi gations on 
Organizations of Production Processes with Tree Structure," Mat hema tical 
Systems Theory and Economics , ed. H. W. Kuhn and G. P. Szego, VoT . il , 
Berlin (1969), pp. 421 if on trees . 

(8) We should note that we are making a heroic assumption that costs (and 
benefits) for all x^Q are zero. 

(9) D. Krathwohl , "A Paradigm for the Development of Research Designs." 
Presented at the American Educational Research Association, 1970 Annual 
Meeting, Minneapolis (1970). 

(10) Cf. G. E. Lundin and G. A. Welty, "Relevance of a Managerial Decision- 
Model to Educational Administration." Presented at the American 
Educational Research Association , 1970 Annual Meeting, Minneapolis 
(1970). Available as ERIC Ed-041 -356. 

(11) Cf. 0. Morgenstern, Prolegomena to A Theory of Organization , Santa 
Monica (1951), pp. 95ff on size and height relationships. 

(12) Cf. A. Downs, Inside Bureaucracy , Boston (1967), p. 118. 
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Footnotes - continued 



(13) G. Welty and E. Lundin, "Management Models and Large-Scale Structures." 
Presented at the Association for Educational Data Systems, 1970 Annual 
Convention, Miami Beach (1970). Available as ERIC ED-041-367. Also, 

G. E. Lundin and G. A. Welty, "Management Models and Educational 
Evaluation," Journal of Research and Development in Education III, 
(1970), pp. 4T3f5\ 

(14) The only proof of this theorem that I know is in R. Kulikowski, 
"Synthesis and Optimum Control of Organization in Large Scale Systems," 
Archiwum Automatydi i Telemechaniki 15? (1967), a relatively inaccessable 
East European journal . Hence, I have provided a proof of my wn, which 
can be generalized from a two-level heirarchy to an n-level heirarchy 

by mathematical induction. 
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